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A  new  method  for  state  of  health  (SOH)  and  remaining  useful  life  (RUL)  estimations  for  lithium-ion 
batteries  using  Dempster-Shafer  theory  (DST)  and  the  Bayesian  Monte  Carlo  (BMC)  method  is  proposed. 
In  this  work,  an  empirical  model  based  on  the  physical  degradation  behavior  of  lithium-ion  batteries  is 
developed.  Model  parameters  are  initialized  by  combining  sets  of  training  data  based  on  DST.  BMC  is  then 
used  to  update  the  model  parameters  and  predict  the  RUL  based  on  available  data  through  battery  capacity 
monitoring.  As  more  data  become  available,  the  accuracy  of  the  model  in  predicting  RUL  improves.  Two 
case  studies  demonstrating  this  approach  are  presented. 

©  201 1  Elsevier  B.V.  All  rights  reserved. 


1.  Introduction 

Lithium-ion  batteries  are  a  common  energy  solution  for  many 
types  of  systems  including  consumer  electronics,  electric  vehi¬ 
cles,  and  military  and  aerospace  electronics,  due  to  their  high 
energy  density,  high  galvanic  potential,  lightness  of  weight, 
and  long  lifetime  compared  to  lead-acid,  nickel-cadmium,  and 
nickel-metal-hydride  cells  [1,2].  The  degradation  of  a  lithium- 
ion  battery  can  be  characterized  by  the  decrease  in  capacity  over 
repeated  charge  cycles.  Capacity  is  the  amount  of  electrical  charge 
a  battery  can  hold  in  its  fully  charged  state.  For  many  applications, 
failure  is  considered  to  occur  when  the  capacity  of  the  battery  is 
reduced  to  below  80%  of  its  rated  value  [3,4].  At  this  point,  the 
battery  is  considered  to  be  an  unreliable  power  source  and  should 
be  replaced,  because  it  tends  to  exhibit  an  exponential  decay  of 
capacity  after  it  passes  this  point. 

Failure  of  a  battery  could  lead  to  loss  of  operation,  reduced  capa¬ 
bility,  downtime,  and  even  catastrophic  failure.  For  example,  in 
April  2000  a  battery  failure  resulted  in  an  electrical  malfunction  that 
disabled  normal  landing  gear  extension  capability  and  led  to  the 
crash  of  a  plane  during  landing.  Another  battery  failure  caused  the 
loss  of  the  Mars  global  surveyor  in  November  2006.  In  this  case,  the 
surveyor’s  batteries  were  exposed  to  sunlight,  and  the  high  temper¬ 
ature  resulted  in  the  premature  depletion  of  the  batteries.  Recently, 
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a  survey  conducted  by  Emerson  Network  Power  showed  that  one 
of  the  biggest  causes  of  data  center  downtime  is  uninterruptible 
power  supply  (UPS)  battery  failures.  For  data  centers,  one  hour  of 
downtime  could  lead  to  tens  of  thousands  of  dollars  in  losses. 

Prognostics  and  health  management  (PHM)  is  an  enabling 
discipline  consisting  of  technologies  and  methods  to  assess  the 
reliability  of  a  product  in  its  actual  life  cycle  conditions  to  deter¬ 
mine  the  advent  of  failure  and  mitigate  system  risk  [5].  With  a 
PFIM  system  for  batteries  in  place,  maintenance  decisions  can  be 
made  on  a  conditional  basis  and  users  can  be  given  ample  fore¬ 
warning  before  a  failure  occurs  so  that  risk  factors  can  be  mitigated. 
PHM  comes  in  two  main  approaches:  physics-of-failure  (PoF)  and 
data-driven.  PoF-based  prognostic  methods  utilize  knowledge  of  a 
product’s  life  cycle  loading  conditions,  geometry,  material  proper¬ 
ties,  and  failure  mechanisms  to  estimate  its  remaining  useful  life 
(RUL)  [6,7].  Data-driven  techniques  extract  features  from  perfor¬ 
mance  data  such  as  current,  voltage,  time,  and  impedance,  using 
statistical  and  machine  learning  techniques  to  track  the  product’s 
degradation  and  estimate  its  RUL  [8].  Data-driven  methods  do  not 
require  specific  knowledge  of  material  properties,  constructions, 
or  failure  mechanisms  [9],  and  avoid  developing  high-level  phys¬ 
ical  models  of  the  system,  so  that  they  are  less  complex  than  PoF 
based  approaches.  Data-driven  methods  can  capture  the  inherent 
relationships  and  learn  trends  present  in  the  data  to  provide  RUL 
predictions. 

Kozlowski  [10]  proposed  a  data-driven  prognostic  approach 
that  combines  three  predictors—  auto-regressive  moving  average 
(ARMA),  neural  networks,  and  fuzzy-logic—  to  predict  the  RUL  of 
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Fig.  1.  The  curve  fitting  of  the  model  Eq.  (1 )  to  the  type  A  battery  data. 


batteries.  These  predictors  were  trained  by  the  data  sets  of  batteries 
of  the  same  size  and  chemistry  under  various  loading  conditions. 
However,  collecting  training  data  that  has  good  coverage  over  all 
the  possible  loading  conditions  can  be  time  consuming  and  expen¬ 
sive.  Burgess  proposed  a  method  to  estimate  the  RUL  for  valve 
regulated  lead-acid  batteries  based  on  capacity  measurements  and 
Kalman  filtering  [11].  The  capacity  fade  trend  is  divided  into  two 
phases:  a  slowly  decreasing  phase  followed  by  a  much  more  rapid 
decreasing  phase.  When  the  battery  capacity  falls  to  the  second 
phase,  the  Kalman  filter  is  trigged  to  give  predictions  of  RUL  based 
on  a  probabilistic  capacity  fade  model.  However,  the  duration  of 
the  second  phase  of  battery  capacity  fade  is  very  short  compared 
to  the  whole  battery  life,  so  this  approach  cannot  give  predictions 
at  an  early  time  of  a  battery’s  life.  Saha  et  al.  [12,13]  used  the  rel¬ 
evance  vector  machine  (RVM)  and  a  particle  filter  to  predict  RUL 
of  lithium-ion  batteries.  In  their  method,  RVM  was  employed  to 
learn  the  non-linear  patterns  in  data,  and  particle  filter  is  used  to 
estimate  the  RUL  with  a  state-space  model  based  on  impedance 
spectroscopy  data.  This  approach  shows  good  accuracy.  However, 
the  impedance  measurement  requires  expensive  and  bulky  equip¬ 
ment  and  is  time  consuming.  In  addition,  the  battery  should  be 
disconnected  from  the  charger  or  load  during  the  measurement. 
These  shortcomings  confine  its  implementation  in  on-board  appli¬ 
cations. 

To  solve  these  problems,  a  new  battery  PHM  approach  is  pro¬ 
posed  in  this  paper,  aiming  at  on-board  applications  and  RUL 
predictions  from  an  early  point  in  the  battery’s  life.  Based  on  data 
analysis,  a  new  model  consisting  of  two  exponential  functions  is 
developed  to  model  the  battery  capacity  fade.  This  model  has  a 
good  balance  between  the  modeling  accuracy  and  complexity,  and 
can  accurately  capture  the  non-linearity  of  the  battery  capacity  fade 
trend.  In  order  to  achieve  accurate  prediction  from  an  early  point 
in  life,  two  algorithms  are  used  to  make  the  model  parameters 
quickly  adapt  to  a  specific  battery  system  and  loading  condition. 
The  first  step  is  an  initial  model  parameter  selection  based  on  the 
Dempster-Shafer  theory  (DST)  [14,15].  The  DST  is  an  effective  data 
fusion  method.  It  has  a  lot  of  applications  in  sensor  information 
fusion  [16-18],  expert  opinion  combination,  and  classifier  com¬ 
bination  [19-21].  DST  allows  one  to  gather  the  information  from 


available  battery  data  to  elicit  the  initial  model  parameters  with 
the  highest  degree  of  belief.  The  second  step  is  the  Bayesian  Monte 
Carlo  (BMC)  [22-24],  which  is  used  to  update  the  model  parameters 
based  on  new  measurements.  With  the  tuned  parameters  obtained 
by  BMC,  the  capacity  fading  model  can  be  extrapolated  to  provide 
the  SOH  and  RUL  predictions.  It  will  be  shown  in  the  case  studies 
that  BMC  can  give  more  accurate  parameter  estimations  than  the 
extended  Kalman  filter  (EKF).  Compared  to  traditional  battery  RUL 
prognostic  methods,  like  those  in  Refs.  [10-13],  the  advantages  of 
the  proposed  battery  prognostic  approach  are:  the  ability  to  provide 
accurate  prediction  from  an  early  point  of  the  battery’s  life,  no  need 
for  a  large  amount  of  training  data,  and  the  potential  application  to 
on-board  battery  PHM  systems. 

This  paper  is  organized  as  follows.  Section  2  introduces  the  bat¬ 
tery  capacity  degradation  model  developed  in  this  study.  Section 
3  discusses  the  uncertainties  in  the  battery  degradation  process. 
Section  4  introduces  the  Dempster-Shafer  theory  and  its  applica¬ 
tion  to  initial  model  parameter  selection.  Section  5  introduces  the 
theory  for  the  Bayesian  Monte  Carlo.  Section  6  presents  the  algo¬ 
rithm  for  the  remaining  useful  life  calculation.  Section  7  presents 
the  application  of  the  proposed  approach  to  battery  prognostics. 
Conclusions  are  drawn  in  Section  8. 

2.  Capacity  degradation  model 

As  a  battery  ages,  the  maximum  available  capacity  of  it  will 
decrease.  To  investigate  the  capacity  fade,  two  types  of  commer¬ 
cialized  lithium-ion  batteries  were  tested.  The  first  type  (type  A) 
has  a  rated  capacity  of  0.9  Ah,  and  the  second  type  (type  B)  has 
a  rated  capacity  of  1.1  Ah.  Both  types  of  batteries  have  a  graphite 
anode  and  a  lithium  cobalt  oxide  cathode  which  were  verified  using 
electron  dispersive  spectroscopy  (EDS).  The  cycling  of  the  batter¬ 
ies  was  accomplished  by  multiple  charge-discharge  tests  using 
an  Arbin  BT2000  battery  testing  system  under  room  temperature. 
The  discharge  current  for  the  type  A  batteries  was  0.45  A,  and  for 
type  B  batteries  it  was  1.1  A.  The  charging  and  discharging  of  the 
batteries  were  cut  off  at  the  manufacturer’s  specified  cutoff  volt¬ 
age.  The  capacity  of  the  tested  batteries  was  estimated  using  the 
Coulomb  counting  method,  since  full  charge-discharge  cycles  were 
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Fig.  2.  The  curve  fitting  of  the  model  Eq.  (1 )  to  the  type  B  battery  data. 


conducted.  In  actual  practice,  batteries  may  not  always  run  from  a 
fully  charged  state  to  a  fully  discharged  state.  In  industrial  applica¬ 
tions,  a  common  practice  in  battery  management  is  to  conduct  the 
capacity  test  regularly  to  monitor  the  capacity  fade  and  determine 
whether  the  battery  requires  replacement  [4,1 1  ].  The  capacity  data 
obtained  by  capacity  testing  can  be  used  to  predict  the  battery’s 
SOH  and  RUL  based  on  the  proposed  approach  in  this  paper.  There 
also  exist  some  advanced  techniques  that  can  be  used  to  estimate 
capacity  from  partial  discharge  data,  such  as  the  EKF  based  method 
[25]  and  total  least  square  method  [26].  For  more  information  about 
the  capacity  estimation  methods,  readers  can  refer  to  Ref.  [27],  in 
which  several  capacity  estimation  methods  were  reviewed. 

The  capacity  fading  trends  of  the  two  types  of  batteries  are 
shown  in  Figs.  1  and  2  respectively.  It  can  be  seen  that  the  capac¬ 
ity  fade  occurs  in  a  near  linear  fashion  followed  by  a  pronounced 
reduction.  The  loss  of  capacity  is  often  brought  on  by  side  reac¬ 
tions  that  occur  between  the  battery’s  electrodes  and  electrolyte 
which  consume  lithium,  thus  removing  it  from  the  Faradic  pro¬ 
cess.  Solid  precipitates  arise  as  the  product  of  these  side  reactions 
and  adhere  to  the  electrodes,  increasing  the  internal  resistance  of 
the  cell.  The  combined  effects  of  these  reactions  reduce  the  bat¬ 
tery’s  ability  to  store  electrical  energy  [3,28,29].  Fig.  3  shows  the 
impedance  spectroscopy  measurements  for  the  battery  A3.  It  can 
be  seen  that  the  Nyquist  plots  show  a  dramatic  rise  in  the  elec- 
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Fig.  3.  The  impedance  spectroscopy  measurements  for  the  battery  A3  at  different 
cycles. 


trolytic  resistance,  charge  transfer  resistance,  and  the  double  layer 
capacitance  with  increased  cycling  based  on  the  Randles  model. 
This  points  to  increased  resistance  of  the  solid-electrolyte  inter¬ 
face  (SEI)  layer  as  well  as  decomposition  of  the  electrolyte  as  the 
reason  for  capacity  fade.  Refs.  [13,30]  used  the  sum  of  exponen¬ 
tial  functions  to  model  the  increase  of  internal  impedance  due  to 
SEI  thickening  with  time.  As  battery  capacity  fade  is  closely  related 
to  the  internal  impedance  increase,  potential  models  for  capacity 
fade  can  also  be  exponential  models.  Based  on  regression  analy¬ 
sis  of  experimental  data,  it  is  found  that  a  model  in  the  following 
form  can  well  describe  the  capacity  fade  trend  of  many  different 
batteries: 

Q.  =  a  ■  exp(b  ■  k)  +  c  •  exp(d  •  k)  (1) 

where  Q.  is  the  capacity  of  the  battery;  k  is  the  cycle  number;  the 
parameters  a  and  b  can  be  related  to  the  internal  impedance;  and 
c  and  d  stand  for  the  aging  rate. 

To  demonstrate  the  suitability  of  the  model  in  Eq.  (1)  in  depict¬ 
ing  battery  degradation,  Figs.  1  and  2  show  the  curve  fitting  result 
(solid  line)  of  Eq.  (1 )  to  the  capacity  data  of  type  A  and  type  B  bat¬ 
teries,  respectively.  The  model  parameters  were  estimated  by  the 
curve  fitting  tool  in  Matlab.  To  quantify  the  performance  of  the 
model,  the  goodness-of-fit  statistics  [31  ]  are  shown  in  Table  1.  The 
root  mean  squared  errors  (RMSE)  are  close  to  0  while  the  R 2  and 
adjusted  R2  are  near  to  1.  These  statistical  parameters  indicate  that 
the  proposed  model  is  suitable  to  represent  the  capacity  fade  data. 


Table  1 

Goodness  of  fit  statistics. 


Battery  ID 

R2 

Adjusted  R2 

RMSE 

Al 

0.9948 

0.9947 

0.0049 

A2 

0.9912 

0.9911 

0.0055 

A3 

0.9537 

0.9527 

0.0114 

A4 

0.9869 

0.9861 

0.0084 

B1 

0.9909 

0.9909 

0.0190 

B2 

0.9889 

0.9889 

0.0202 

B3 

0.9924 

0.9924 

0.0136 

B4 

0.9929 

0.9929 

0.0203 
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3.  Uncertainties  in  battery  prognostics 

In  this  study,  the  battery  degradation  is  modeled  by  Eq.  (1 ).  This 
model  can  be  well  fit  to  each  battery,  as  shown  in  Figs.  1  and  2.  How¬ 
ever,  it  is  easy  to  see  that  there  can  be  large  discrepancies  between 
each  sample’s  degradation  trends.  These  variations  can  arise  from 
several  sources:  (1)  Inherent  system  uncertainties:  because  of  the 
uncertainties  in  the  manufacturing  assemblies  and  material  prop¬ 
erties,  batteries  may  have  different  initial  capacities,  which  can  be 
observed  from  Fig.  1 .  Each  battery  may  also  be  individually  affected 
by  impurities  or  defects,  which  may  lead  to  different  aging  rates.  (2) 
Measurement  uncertainties:  uncertainties  are  likely  to  arise  from 
background  noise  of  measurement  devices  and  from  system  pro¬ 
cess  noise.  (3)  Operation  environment  uncertainties:  the  rate  of 
capacity  fade  can  be  affected  by  usage  conditions  such  as  the  ambi¬ 
ent  temperature,  discharge  current  rate,  depth  of  discharge,  and 
aging  periods.  (4)  Modeling  uncertainties:  the  regression  model  is 
an  approximation  of  the  battery  degradation,  which  will  result  in 
some  modeling  error. 

In  the  degradation  in  Eq.  (1 ),  the  parameters  a  and  c  characterize 
the  initial  capacity,  meanwhile  the  parameters  b  and  d  represent 
the  aging  rate.  If  the  model  parameters  are  inaccurately  defined, 
errors  will  occur  in  the  prediction.  Uncertainty  management  tools 
are  needed  to  account  for  the  noise  or  errors  in  capacity  estima¬ 
tions,  the  variations  in  battery  chemistries  and  loading  conditions, 
etc.  Therefore,  the  DST  and  BMC  are  adopted  to  ensure  that  the  pro¬ 
posed  degradation  model  adapts  to  a  specific  battery  system  and 
loading  condition.  The  final  RUL  prediction  can  be  obtained  in  the 
form  of  a  probability  density  function  so  that  the  confidence  level 
of  the  prediction  can  be  assessed. 

4.  Model  initialization  using  Dempster-Shafer  theory 

To  provide  accurate  predictions  from  an  early  point  in  life,  it  is 
critical  that  these  model  parameters  are  well  representative  of  the 
true  physical  response  of  the  battery.  The  available  battery  data  can 
be  used  to  initialize  these  parameters.  A  good  combination  of  the 
initial  parameters  will  shorten  the  convergence  time  of  the  model 
to  the  real  system  respond.  Here,  we  use  the  mixing  combination 
rule  of  the  Dempster-Shafer  theory  to  get  the  basis,  or  the  “prior 
model”,  for  the  BMC  updating.  The  mixing  combination  rule  was 
proposed  to  combine  evidence  based  on  the  belief  measure  of  each 
data  set  [15].  It  assumes  that  if  two  bodies  of  evidence  agree,  they 
should  be  given  a  higher  value  of  belief  and  hence  weigh  more 
when  combining  each  of  the  pieces  of  evidence  together  [32].  The 
detailed  steps  of  DST  in  initializing  model  parameters  are  illustrated 
as  follows  using  the  data  from  batteries  Al,  A2,  and  A3. 

First,  the  Gauss-Newton  algorithm  in  the  Matlab  curve  fitting 
tool  was  used  to  fit  the  proposed  model  to  each  subset  of  data  in 
the  training  set.  These  fits  produced  the  parameter  estimations  with 
95%  confidence  bounds  shown  in  Table  2. 

Next,  each  of  the  parameters  from  the  respective  data  sets, 
expressed  through  confidence  intervals,  were  compared  in  order 
to  calculate  the  belief  measure  associated  with  each  parameter. 
Initially,  because  we  assume  all  sources  to  be  equally  credible;  the 
basic  belief  assignment,  which  assesses  the  likelihood  of  each  set, 
is  given  an  equal  value: 

m(A)  =  1  (2) 

where  m(Az  )  is  the  basic  belief  assignment  for  a  set  Az  and  n  is  the 
number  of  sets  in  the  training  set  family.  Since  3  training  data  sets 
were  used,  the  initial  basic  belief  assignment  for  each  data  set  is 
0.333.  By  using  this  as  a  starting  point  we  can  calculate  the  belief 
measure  of  each  parameter.  The  belief  measure  Be/(AZ  )  for  a  set  At  is 


Table  2 

Fitted  parameters  from  each  set  of  training  data,  including  the  bounds  for  the  95% 
confidence  intervals. 


Battery  ID 

Parameter 

Low  bound 

Mean 

Upper  bound 

a 

— 1.660E— 03 

-1.042E-03 

-4.240E-04 

Al 

b 

2.068E-02 

2.268E-02 

2.467E-02 

c 

9.079E— 01 

9.190E-01 

9.301E-01 

d 

-1.210E-03 

-1.035E-03 

— 8.600E— 04 

a 

-2.007E-06 

-9.860E-07 

3.442E-08 

A2 

b 

5.283E— 02 

5.752E-02 

6.221E-02 

c 

8.931E-01 

8.983E-01 

9.035E-01 

d 

— 9.007E— 04 

-8.340E-04 

-7.670E-04 

a 

— 3.788E— 05 

-1.530E-05 

7.272E-06 

A3 

b 

5.398E-02 

6.296E-02 

7.193E-02 

c 

8.631E-01 

8.757E— 01 

8.883E-01 

d 

-1.188E-03 

-9.400E-04 

-6.920E-04 

Table  3 

Belief  values  for  each  parameter. 


Battery  ID 

a 

b 

c 

d 

Al 

0.333 

0.333 

0.333 

0.333 

A2 

0.333 

0.333 

0.333 

0.333 

A3 

0.666 

0.333 

0.333 

0.666 

defined  as  the  sum  of  all  the  basic  belief  assignments  of  the  subsets 
of  the  set  of  interest: 

Bel(Aj)  —  J2  m W  (3) 

allAjCiAi 

Eq.  (3)  implies  that  we  must  consider  parameter  intervals  that  are 
subsets  of  other  parameter  intervals  in  order  to  compute  the  belief 
measure.  Take  the  parameter  a  for  example,  In  Table  2  the  param¬ 
eter  interval  of  A3  contains  that  of  A2.  As  a  result,  the  belief  value 
of  A3  for  the  parameter  a  is  0.333  +  0.333  =  0.666.  This  analysis  pro¬ 
vides  us  with  the  following  belief  values  for  each  of  the  parameters 
from  the  training  data  set  family  shown  in  Table  3.  Now  that  the 
belief  measures  have  been  evaluated  for  each  parameter,  we  can 
go  back  and  update  the  basic  belief  assignments  from  the  belief 
measure  with  the  following  inverse  function, 

m(Ai)=  Y)  (-if^'BeliAj)  (4) 

allAjCiAi 

where  \Ai~Aj\  is  the  difference  of  the  cardinality  of  the  two 
sets.  When  computing  the  cardinality  of  each  parameter  set,  the 
Lebesgue  measure  must  be  used,  because  each  interval  was  defined 
only  by  its  upper  and  lower  bounds  and  is  therefore  uncount¬ 
able.  However,  because  the  intervals  are  so  small,  and  the  sizes 
of  the  intervals  are  relatively  similar,  the  difference  in  cardinalities 
between  A/  and  Aj  can  be  considered  zero.  Therefore,  the  assign¬ 
ment  conversion  for  this  special  case  can  be  approximated  by: 

m(A)~  Y  Bel(Aj]  (5) 

allAjcAi 

Using  this  to  convert  back  to  the  basic  belief  assignment,  and  then 
normalizing  these  assignments,  the  values  for  m  can  be  obtained  as 


Table  4 

Basic  assignments  for  each  parameter  value. 


Battery  ID 

a 

b 

c 

d 

Al 

0.2 

0.333 

0.333 

0.2 

A2 

0.2 

0.333 

0.333 

0.2 

A3 

0.6 

0.333 

0.333 

0.6 
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shown  in  Table  4.  Now  each  parameter  can  be  combined  using  the 
weighted  arithmetic  mean: 

3 

CP  =  ^m(A,)h(A,)  (6) 

1=1 

where  h(A2)  is  the  estimated  parameter  from  training  data  CP 
is  the  combined  parameter  from  the  initial  model,  and  m(A2)  are 
the  basic  belief  assignments  or  the  weight  factor.  This  gives  us  the 
following  combined  parameter  values: 

a  =  -0.00022 
b  =  0.04772 

c  =  0.89767  1  j 

d  =  -0.00094 


5.  Model  updating  via  Bayesian  Monte  Carlo 


Once  the  initial  parameter  values  are  determined  and  capac¬ 
ity  data  are  collected,  the  parameters  can  be  updated  based  on 
Bayes’rule.  The  estimation  of  the  parameters  will  gradually  con¬ 
verge  to  their  true  values  as  more  and  more  capacity  data  becomes 
available. 

To  model  the  uncertainty  as  discussed  above,  it  is  assumed  that 
the  parameters:  a,  b ,  c,  and  d,  as  well  as  the  error  of  the  regression 
model,  are  subject  to  Gaussian  distribution: 

dk  =  G/<- 1  +  0)a  tea~N{ 0,  Cfa) 

bk  =  bk_ !  +  cob  cob~M[ 0,  ab)  ^ 

Ck  =  Ck_,  +  COc  <WC~M 0,  Gq ) 

dk  =  4-1  +  0,  o-d) 


Qk  =  alr  exp(bk-k)  +  ck-  exp(dk  k)  +  v  v~N[0,aa)  (9) 


where  Q/<  is  the  capacity  measured  at  cycle  /<,  and N[0,  cr)  is  Gaussian 
noise  with  zero  mean  and  standard  deviation  cr. 

The  initial  values  a0,  b0 ,  c0,  and  d0  are  set  as  the  weighted  sum 
of  the  model  parameters  obtained  from  the  training  data  based  on 
DST.  For  convenience,  we  denote  X/<:  =  [ ak ,  bk ,  ck ,  d/J  as  the  parameter 
vector  at  cycle  k.  The  goal  of  this  study  is  to  estimate  the  probability 
distribution  P(Xk |Qo:/<)  of  the  parameter  vector  Xk  given  a  series  of 
capacity  measurements:  Qo:k  =  [Qo,  Qi,  . . Q/<]-  Within  a  Bayesian 
framework,  the  posterior  distribution  P{Xk\Qjj.k)  can  be  recursively 
computed  by  two  steps:  prediction  and  update.  Given  the  proba¬ 
bility  distribution  P{Xk_ ^  |Qo:/<— 1 ) cycle  k  - 1 ,  the  prediction  stage 
involves  using  the  model  (8)  to  obtain  the  prior  probability  distri¬ 
bution  ofXk  via  the  Chapman-Kolmogorov  equation: 


p{xk\a0:k_^) 


/ 


P(X/jX/<_1)P(X/<_1|Q0:k_1)dX/<_1 


(10) 


At  cycle  /<,  a  new  observation  Q/<  is  obtained  and  used  to  update  the 
prior  distribution  via  Bayes’rule  [22,23  ],  so  as  to  obtain  the  required 
posterior  distribution  of  Xk  as  follows: 


P(XfclQo:fc) 


PCXfclQoifc-aPCQfclXfc) 

pmQ.o±-0 


(11) 


where  the  normalizing  constant  is: 

nQklQo:k-i)=  [  PCXklQo^MQklXkJdXk  (12) 


The  recurrence  relation  between  Eqs.  (10)  and  (11)  forms  the  basis 
for  the  exact  Bayesian  solution  [22,23].  However,  this  recursive 
propagation  of  the  posterior  density  is  only  a  conceptual  solution 
in  general.  It  is  hard  to  analytically  evaluate  these  distributions, 
because  they  require  the  evaluation  of  complex  high-dimensional 
integrals  [22].  However,  it  is  possible  to  approximately  and  numer¬ 
ically  solve  this  Bayesian  updating  problem  by  adopting  Monte 


Carlo  sampling  [22,23].  The  key  idea  is  to  represent  the  probability 
density  function  (PDF)  by  a  set  of  random  samples  with  associ¬ 
ated  weights  and  compute  estimates  based  on  these  samples  and 
weights  as  below: 

N 

PiXMo^v^coiSiXk-Xi)  (13) 

1  =  1 


where  X^,  i  =  1 , 2,  3, . . . ,  N,  is  a  set  of  independent  random  sam¬ 
ples  drawn  from  P(X/<|Q0:/<:);  colk  is  the  Bayesian  importance  weight 
associated  with  each  sample  X^;  and  <$(•)  is  the  Dirac  delta  func¬ 
tion.  In  practice,  P(Xk |Qo:k)  is  usually  unknown.  In  this  case,  one  can 
resort  to  importance  sampling,  i.e.,  to  sample  X^  from  an  arbitrar¬ 
ily  chosen  distribution  7r(Xjc|Q.0:k)  called  the  importance  function. 
Then  the  estimate  of  a)lk  can  be  obtained  by  [22-24]: 


^  =  P((lo:k\X[)P(X[ ) 

7r(X'|Q0:k) 

The  weight  should  be  normalized  by: 


(14) 


(15) 


A  recursive  formula  for  updating  the  weights  can  be  obtained  by 
[24]: 


PjQklKWKWc-i) 

n(X[\x[_v(l0:k) 


(16) 


If  the  importance  function  is  chosen  by  7t(Xlk\Xlk  l,  Q0:k)  = 
P(X lk\Xlk  A ),  then  the  weight  updating  rule  becomes: 


te[  =  co[_1P(Qk\x[)  (17) 

As  the  number  of  Monte  Carlo  sampling  oo,  the  approximation 
Eq.  (13)  approaches  the  true  posterior  density  P(X/<|Q0:/J. 


6.  The  SOH  prognostics  and  RUL  estimation 

Using  the  Bayesian  Monte  Carlo  approach,  the  parameter  vector 
can  be  updated  at  each  cycle.  In  the  updating  procedure,  N  samples 
are  used  to  approximate  the  posterior  PDF.  Each  sample  represents 
a  candidate  model  vectorX^,  i  =  1 , 2, . . .,  N,  so  the  prediction  of  Qwill 
have  N  possible  trajectories  with  the  corresponding  importance 
weights  cok.  Then,  the  h-step  ahead  prediction  of  each  trajectory 
at  cycle  k  can  be  calculated  by: 

Ql+h  =  <  •  exp[b‘  •  (k  +  h)}  +  c‘  •  exp[d'  •  (k  +  h)}  (18) 

The  estimated  posterior  PDF  of  the  prediction  can  be  obtained  by 
the  prediction  at  each  trajectory  with  associated  weights: 

N 

Pm+hlOo-.O^Jf^Ck^-Ql^)  (19) 

1=1 

The  expectation  or  mean  of  the  h-step  ahead  prediction  at  the  cycle 
k  is  given  by: 


N 


1=1 


Since  the  failure  threshold  is  defined  as  80%  of  the  rated  capacity, 
the  RUL  estimation  Llk  of  the  ith  trajectory  at  the  cycle  k  can  be 
obtained  by  solving  the  following  equation: 

Qk  '  exP[fak  •  (fc  +  4)1  +  4  •  exPK  •  (k  +  4)1  =  °-8Qrated  (21 ) 
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Fig.  4.  The  flowchart  of  the  proposed  scheme  for  battery  prognostics. 


Then,  the  distribution  of  RUL  at  the  cycle  k  can  be  approximated 
by: 

N 

P(Lk  (22) 

Z  =  1 

The  expectation  or  mean  of  the  RUL  prediction  at  cycle  k  is  given 
by: 

N 

=  (23) 

1  =  1 

As  a  summary,  Fig.  4  presents  the  flowchart  of  the  proposed 
prognostic  scheme.  First,  DST  is  used  to  combine  the  available  bat¬ 
tery  data  sets  so  as  to  get  a  starting  point  for  BMC  updating.  As  the 
capacity  measurements  of  the  monitored  battery  become  available, 
model  parameters  are  updated  by  BMC  to  track  the  degradation 
trend  of  the  battery.  The  RUL  prediction  can  be  made  by  extrapo¬ 
lating  the  model  to  the  failure  threshold. 

7.  Prognostic  results 

In  this  section,  two  case  studies  are  conducted  to  validate  the 
proposed  approach.  In  the  first  case  study,  the  data  from  Al,  A2 
and  A3  are  used  to  elicit  the  initial  model  by  the  DST.  A4,  which 
shows  the  largest  difference  in  its  capacity  fade  trend  compared  to 
the  other  three  batteries,  is  used  as  the  testing  sample  to  validate 
the  proposed  algorithm.  Similarly,  in  the  second  case  study,  initial 
model  parameters  are  selected  based  on  Bl,  B2,  and  B3,  and  B4 
is  used  for  testing.  The  error  of  the  mean  RUL  estimation  and  the 
standard  deviation  (SD)  of  the  RUL  estimation  are  used  to  quantify 
the  performance  of  the  proposed  methodology. 

The  prognostic  results  for  A4  at  18  cycles  are  shown  in  Fig.  5, 
where  only  data  from  the  first  18  cycles  are  used  to  update  the 
model.  The  error  of  the  mean  RUL  prediction  is  1  cycle,  and  the  SD 
of  the  estimated  RUL  is  6  cycles.  Fig.  6  presents  the  prediction  result 
of  A4  at  32  cycles.  Since  more  data  are  available  to  update  the  model 
parameters,  the  accuracy  of  the  mean  RUL  prediction  is  improved 
as  the  predicted  failure  cycle  matches  with  the  real  value,  and  the 
SD  of  the  RUL  prediction  is  reduced  to  2  cycles,  meaning  that  the 
confidence  level  of  the  prediction  increases. 

Fig.  7  shows  the  prognostic  results  for  battery  B4  at  250  cycles. 
The  predictions  in  the  solid  line  well  capture  the  non-linear  fade 
trend  of  battery  capacity.  The  prediction  error  of  the  failure  cycle  is 
7  cycles  away  from  the  actual  failure  cycle,  and  the  SD  of  the  RUL 
prediction  is  35  cycles.  Based  on  the  RUL  PDF,  the  95%  confidence 
bound  of  the  predicted  failure  cycle  can  be  obtained  as  550-670 
cycles. 

To  demonstrate  the  effectiveness  of  DST  in  aggregating  infor¬ 
mation  from  training  data,  comparison  studies  were  conducted 


Fig.  5.  Prediction  result  at  18  cycles  for  the  battery  A4.  The  BMC  prediction  model 
was  initialized  by  DST.  The  prediction  error  is  1  cycle,  and  the  standard  deviation  of 
RUL  estimation  is  6  cycles. 

between  DST  and  a  mean  averaging  approach.  In  the  mean  aver¬ 
aging  approach,  the  initial  parameters  are  defined  by  the  average 
of  each  parameter  from  each  training  data  set  and  are  used  as  the 
starting  point  for  BMC  updating.  The  prediction  results  of  the  mean 
averaging  approach  for  A4  at  18  cycles  and  B4  at  250  cycles  are 
shown  in  Figs.  8  and  9,  respectively.  In  Fig.  8,  the  prediction  error 
and  SD  are  4  and  12  respectively,  which  are  greater  than  those 


Cycle 

Fig.  6.  Prediction  result  at  32  cycles  for  the  battery  A4.  The  BMC  prognostic  model 
was  initialized  by  DST.  BMC  accurately  predicted  the  failure  time.  The  standard 
deviation  of  the  RUL  estimation  is  2  cycles. 
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Fig.  7.  Prediction  results  at  250  cycles  for  the  battery  B4.  The  BMC  prognostic  model 
was  initialized  by  DST.  The  prediction  error  is  7  cycles,  and  the  standard  deviation 
of  the  RUL  estimation  is  35  cycles. 


Fig.  8.  Prediction  results  at  1 8  cycles  for  the  battery  A4.  The  initial  model  parameters 
were  defined  by  the  mean  averaging  approach.  The  prediction  error  is  4  cycles,  and 
the  standard  deviation  of  the  RUL  estimation  is  12  cycles. 


Cycle 

Fig.  9.  Prediction  results  at  250  cycles  for  the  battery  B4.  The  initial  model  parame¬ 
ters  were  defined  by  the  mean  averaging  approach.  The  prediction  error  is  31  cycles, 
and  the  standard  deviation  of  the  RUL  estimation  is  62  cycles. 


Fig.  10.  Prediction  results  at  250  cycles  for  the  battery  B4  using  extended  Kalman 
filtering.  The  prediction  error  is  52  cycles. 


obtained  by  using  the  DST  (Fig.  5).  In  Fig.  9,  the  prediction  error  is 
31  cycles.  It  is  24  cycles  larger  than  the  prediction  error  obtained 
by  the  DST.  In  addition,  the  SD  of  the  RUL  estimation  in  Fig.  9  is 
62  cycles,  which  is  27  cycles  larger  than  that  obtained  by  the  DST 
(Fig.  7).  Therefore,  the  DST  has  been  shown  to  be  effective  in  fusing 
the  available  training  data  to  provide  the  optimal  initial  parameters 
to  start  the  BMC  updating. 

To  compare  the  performance  of  the  BMC  with  EKF,  Fig.  10  shows 
the  prediction  results  based  on  EKF  for  the  battery  B4.  The  degrada¬ 
tion  model  and  initial  parameters  used  in  EKF  are  the  same  as  those 
used  in  BMC.  In  Fig.  10,  the  EKF  over-predicted  the  failure  cycle  of 
the  battery,  and  the  prediction  error  of  the  failure  cycle  is  52  cycles, 
which  is  greater  than  that  obtained  by  BMC  by  45  cycles. 

The  BMC  approach  is  computationally  efficient.  In  the  case 
study,  1 000  samples  were  used  in  the  BMC.  The  computational  time 
of  the  BMC  parameter  updating  at  each  cycle  was  within  10  ms 
using  an  Intel  Core  i7  M60  2.67  GFIz  processor  and  4  Gb  RAM  under 
a  Matlab  2010  environment. 

8.  Conclusions 

Analysis  of  lithium-ion  battery  data  shows  that  capacity  fade  can 
be  modeled  by  the  sum  of  two  exponential  functions  of  discharge 
cycles.  RUL  predictions  can  then  be  made  by  extrapolating  the 
capacity  fade  model  to  the  failure  threshold.  To  estimate  the  model 
parameters  and  predict  the  RUL,  a  data-driven  approach  based  on 
the  DST  and  BMC  was  developed.  The  DST  was  used  to  select  the  ini¬ 
tial  model  parameters  for  the  BMC  parameter  estimation.  The  BMC 
is  a  combination  of  Monte  Carlo  and  Bayesian  updating.  In  the  BMC 
algorithm,  a  set  of  possible  degradation  trajectories  are  simulated 
based  on  the  capacity  fade  model.  Each  trajectory  is  then  assigned 
a  weight  according  to  its  conformity  to  the  capacity  measurements 
using  the  Bayesian  rule.  The  model  parameters  are  estimated  as 
the  weighted  sum  of  the  model  parameters  defined  by  each  tra¬ 
jectory.  The  RUL  PDF  is  approximated  by  the  RUL  estimation  at 
each  simulated  degradation  trajectory  with  associated  weights.  The 
mean  RUL  estimation  is  given  by  the  weighted  sum  of  the  RUL  esti¬ 
mation  of  each  simulated  trajectory.  Based  on  the  obtained  RUL 
information,  advance  warning  of  the  battery  failure  can  be  achieved 
and  preventive  maintenance  of  the  battery  can  be  scheduled  so  as 
to  improve  the  availability  and  reliability  of  the  battery-powered 
system. 

To  show  how  the  method  can  be  applied,  we  conducted  case 
studies.  It  was  found  that  the  proposed  approach  performed  bet¬ 
ter  than  the  traditional  methods.  Compared  to  the  mean  averaging 
method,  the  prediction  accuracy  at  250  cycles  for  battery  B4  was 
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improved  by  24  cycles  when  using  the  DST  to  define  the  initial 
model  parameters.  In  addition,  by  using  the  BMC,  the  mean  RUL 
estimation  for  the  battery  B4  was  improved  by  45  cycles  in  the 
accuracy  as  compared  to  the  extended  Kalman  filter.  Therefore, 
the  capacity  fade  model  can  efficiently  converges  to  the  battery 
degradation  trend  by  using  the  proposed  parameter  estimation 
approach,  and  accurate  RUL  predictions  can  be  achieved  from  an 
early  point  of  the  battery  life.  Another  merit  of  the  proposed  method 
is  that  the  RUL  prediction  can  be  given  in  a  form  of  probabil¬ 
ity  distribution,  so  that  the  confidence  level  of  the  prediction  can 
be  assessed.  The  narrower  RUL  PDF  indicates  a  higher  prediction 
confidence. 

The  contributions  of  this  study  can  be  summarized  in  three 
points:  the  first  is  a  new  model  for  the  capacity  degradation  of 
lithium-ion  batteries.  This  model  can  well  characterize  the  non¬ 
linear  trend  of  capacity  fade  and  is  simple  enough  for  on-board 
applications.  Using  this  model  and  the  proposed  parameter  estima¬ 
tion  method  in  this  paper,  accurate  RUL  prediction  can  be  achieved 
from  an  early  point  of  the  battery’s  life.  The  second  is  a  novel 
method  based  on  DST  to  solve  the  model  initialization  problem, 
which  is  common  for  parameter  estimation  algorithms  in  battery 
modeling,  including  least  square,  Kalman  filter,  and  BMC.  Tradi¬ 
tionally,  the  initial  parameter  is  selected  randomly  or  based  on 
experience.  However,  poor  initial  parameters  can  make  the  esti¬ 
mation  converge  slowly  or  even  diverge.  This  research  provides  a 
simple  but  effective  parameter  initializing  method  based  on  DST. 
The  third  is  a  Bayesian  Monte  Carlo  approach  adopted  to  esti¬ 
mate  the  model  parameters  and  provide  the  RUL  prediction.  This 
method  can  take  into  account  the  measurement  noise  and  dynami¬ 
cally  update  the  model  parameters  based  on  new  measurements  so 
as  to  provide  accurate  estimations.  The  improvements  of  the  BMC 
over  the  commonly  used  extended  Kalman  filter  in  parameter  esti¬ 
mation  can  be  seen  from  the  comparison  study.  The  BMC  can  also 
be  applied  to  other  estimation  and  identification  problems  in  the 
battery  research. 

This  work  is  an  initial  effort  towards  a  comprehensive  PHM 
solution  for  lithium-ion  batteries.  It  has  limitations  and  needs 
improvement.  For  example,  the  effects  of  capacity  gain  during  bat¬ 
tery  rest  periods  were  not  considered  in  this  study.  The  models 
for  the  effects  of  rest  should  be  incorporated  into  the  prognostic 
framework  in  the  future  work. 
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